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1. Introduction 



In this paper we prove the following rigidity theorem. 

Theorem 1. Let (M™, g) (n > 2) be a compact Riemannian manifold with nonempty 
boundary E = dM . Suppose 

• Ric> (n — 1) g, 

• (E, g\s) is isometric to the standard sphere S™ -1 C M. n , 

• E is convex in M in the sense that its second fundamental form is nonneg- 
ative. 

Then (M n ,g) is isometric to the hemisphere §5. C K" +1 . 



It may be necessary to make precise certain definitions involved here as there 
are different conventions for the second fundamental form and the mean curvature 
in the literature. Let v be the outer unit normal field of E in M. For any p 6 E, 
for any X, Y £ T p E the second fundamental form is defined as 

U(X,Y) = (Vx^Y). 

The mean curvature is the trace of the second fundamental form. 

Put in another way, the theorem says that for a compact manifold with boundary, 
if we know that the boundary is (intrinsic geometry on the boundary) and 
convex (some extrinsic geometry) then we recognize the manifold as the hemisphere 
§2., provided Ric > (n— l)g. To put this result in a context, we first recall the 
following 

Theorem 2. Let (M n ,g) be a compact Riemannian manifold with boundary and 
scalar curvature R>0. Lf the boundary is isometric to § n_1 and has mean curva- 
ture n — 1, then (M n ,g) is isometric to the unit ball B™ C R™. (If n > 7 we need 
to assume that M is spin.) 

This remarkable result is a simple corollary of the positive mass theorem: indeed 
one may glue M with R"\B™ along the boundary to obtain an asymptotically 
flat manifold N with nonnegative scalar curvature. Since it is actually flat near 
infinity the positive mass theorem implies that TV is isometric to ffi™ and hence M 
is isometric to B™ (see [M, ST] for details). There are similar rigidity results for 
geodesic balls in the hyperbolic space assuming R > — n (n — 1) by applying the 
positive mass theorem for asymptotically hyperbolic manifolds. 

It is a natural question to consider the hemisphere. The following conjecture 
was proposed by Min-Oo in 1995. 
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Conjecture 1. (Min-Oo) Let (M n ,g) be a compact Riemannian manifold with 
boundary and scalar curvature R > n (n — 1). If the boundary is isometric to §™ _1 
and totally geodesic, then (M n ,g) is isometric to the hemisphere S™. 

The proof of Theorem 2 does not seem to work any more: there is no positive 
mass theorem providing a miraculous passage from the compact manifold in ques- 
tion to a noncompact manifold. As it stands this conjecture seems difficult. There 
have only been some partial results in [HW] and some recent progress in dimension 
three in [E]. Theorem 1 can be viewed as the Ricci version of Min-Oo's conjecture. 
It is a strong evidence that Min-Oo's conjecture should be true. 

In dimension 2 it turns out that Theorem 1 is essentially equivalent to a result 
of Toponogov on the length of simple closed geodesies on a strictly convex surface. 
This connection is discussed in Section 2 in which we also present a different proof 
working only in dimension 2. This proof may have some independent interest. 
It is also interesting to compare this two dimensional argument, which is partly 
geometric and partly analytic, with the unified proof of purely analytic nature 
presented in Section 3. 
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2. The two dimensional case 

When ti = 2we consider a compact surface (M 2 , g) with boundary. The bound- 
ary then consists of closed curves and there is no intrinsic geometry except the 
lengths of these curves. The extrinsic geometry of the boundary is given by the ge- 
odesic curvature. Therefore Theorem 1 follows from the following slightly stronger 
result. 

Theorem 3. Let (M 2 ,g) be compact surface with boundary and the Gaussian cur- 
vature K > 1. Suppose the geodesic curvature k of the boundary 7 satisfies k > c 
> 0. Then L(j) < 2-k/^/I + c 2 . Moreover equality holds iff (M,g) is isometric to 
a disc of radius cot~ 1 (c) in § 2 . 

Proof. By Gauss-Bonnet formula 

2ttx (M) = I Kda + I kds> 0, 

J M J7 

where \ (M) is the Euler number of M . Therefore M is simply connected and in 
particular 7 has only one component. By the Riemann mapping theorem, (M,g) 
is conformally equivalent to the unit disc B= {z £ C : \z\ < 1}. Without loss of 
generality, we take (M, g) to be (B,.g = e 2u \dz\ 2 ) with u e C 00 (B,R). By our 
assumptions we have 

f -Au > e 2u on I, 
I §7 + 1 > ce u on S 1 

Let u e C°° (1, M) such that 

f -Au = on B, 
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Then u < u as u is superharmonic. It follows from sub-sup solution method (see, 
e.g., [SY, page 187-189]) that we may find a v e C°° (B,R) with 

f -Av = e 2v on B, 

[ U < V < u. 

Since v < u and v\ s i = we have > ^ and hence +1 > ce u , i.e. the 

boundary circle has has geodesic curvature > c. As the metric (M 7 e 2v \dz\ 2 ) has 
curvature 1 and the boundary circle is convex, it can be isomctrically embedded 
as a domain in S 2 , say fl. Denote a = d£l parametrized by arclength. Notice 
L((j) = L (7) as v = u on the boundary S 1 . Because the boundary has geodesic 
curvature > c > 0, it is known that the smallest geodesic disc D containing f2 
has radius at most cot _1 (c). Hence L (7) = L(a) < 2ir/\/l + c 2 = L(dD). The 
equality case follows directly from the argument. □ 

As a corollary we have the following theorem due to Toponogov. 

Corollary 1. (Toponogov [T]) Let (M 2 , g) be a closed surface with Gaussian curva- 
ture K > 1. Then any simple closed geodesic in M has length at most 2n. Moreover 
if there is one with length 2ir, then M is isometric to the standard sphere S 2 . 

Proof. Suppose 7 is a simple close geodesic. We cut M along 7 to obtain two 
compact surfaces with the geodesic 7 as their common boundary. The result follows 
from applying the previous theorem to either of these two compact surfaces with 
boundary. □ 

Toponogov's original proof, as presented in Klingenberg [K, page 297] uses his 
triangle comparison theorem. In applying the triangle comparison theorem, which 
requires at least two minimizing geodesies, the difficulty is to know how long a 
geodesic segment is minimizing without assuming an upper bound for curvature. 
As the proof presented above, this difficulty is overcome by using special features 
of two dimensional topology. 



3. The proof of the main theorem 



We now present a proof of Theorem 1 which works in any dimension n > 2. We 
first recall the following result due to Reilly. 

Theorem 4. (Reilly [K]) Let (M",j) be a compact Riemannian manifold with 
nonempty boundary S = dM. Assume that Ric > (n — 1) g and the mean cur- 
vature of 'X in M is nonnegative. Then the first (Dirichlet) eigenvalue \\ of —A 
satisfies the inequality Ai > n. Moreover Ai = n iff M is isometric to the standard 
hemisphere ^ C W l+1 . 

Therefore to prove Theorem 1, it suffices to show Ai (M) = n. If this were not 
the case, then Ai (M) > n. Therefore for every / e C°° (£) there is a unique 
u e C°° (M) solving 

, . J —Au = nu on M, 

(dA > { u = f on S. 
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Define 



\Vu\ 2 + u 2 . 



Lemma 1. <\> is subharmonic, i.e. A<j> > 0. 

Proof. Using the Bochncr formula, the equation (3.1) and the assumption Ric> 

{n- i)g, 

-A<j> = \D 2 u\ 2 + (Vu, VAw) + Ric(Vu, Vit) + |Vu| 2 + uAu 
> \D 2 u\ 2 -nu 2 

^ (Aw) 2 

> rat 

n 

= 0. 

□ 

Denote \ = the derivative on the boundary in the outer unit normal v. By 
the assumption of Theorem 1 there is an isometry F : (£,<?|s) — > §™ _1 C W 1 . In 
the following let / = ^ILi ° -^i where the standard coordinate 

functions on and a — (ct\, • • • , a n ) G S" _1 . We have 

-A E / = (n-l)/, |V E /| 2 + / 2 = 1. 

Hence 

(3.2) ^HV s ./f + X 2 + ./- 2 = l + X 2 . 
On the boundary S 

-nf = Au| s = A s / + H X + D 2 u (u, v) = - (n - 1) / + H X + D 2 u (v, v) , 
whence 

(3.3) D 2 u (is, u) + f= -H X . 



Lemma 2. On £ 

2dv 



= (Ve/, V SX ) - H X 2 - H (V E /, Ve/) • 



Proof. Indeed 

2 5^ 



£ 2 u (Vu, i/) + fx 

D 2 u (V E «, + X (^ 2 « (i>, + /) 



= D 2 u(Vzf,v)-H X z , 
here we have used (3.3) in the last step. On the other hand 
D 2 u(V^f,v) = (Vvs/Vu,!/) 

= Ve/(Vm,i/)-(Vm,V Vs /^) 

= (v s /,v EX )-n(v s /,v s /). 

The lemma follows. □ 
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Lemma 3. The function <f> = | Vit| + u 2 is constant and 

D 2 u = —ug. 

Moreover \ = * s a ^ so constant and II (Ve/, Ve/) = 0. 

Proof. Since is subharmonic, by the maximum principle </> achieves its maximum 
on E, say at p G E. Obviously we have 

V s </>(p) = 0, |^(p)>o. 

If ^ (p) = 0, then must be constant by the strong maximum principle and Hopf 
lemma (see [GT, page 34-35]). Then the proof of Lemma 1 implies D 2 u = —ug. 
By (3.2) x is constant. It then follows from Lemma 2 that II (Vs/, Vs./) = 0. 

Suppose (p) > 0. Then \ (?) 7^ 0, for otherwise it follows from (3.2) that 
X = and hence §^ (p) < by Lemma 2, a contradiction. From (3.2) we conclude 
VeX (p) = 0. By Lemma 2 

~ (p) = (Ve/, Vex) (p) - #X 2 - n (Ve/, Ve/) < 0, 

here we have used the assumption that E is convex, i.e. II > 0. This contradicts 
with |£ (p) > again. □ 



Recall / depends on a unit vector a G § n . To indicate the dependence on a 
we will add subscript a to all the quantities. Since n (Vs/ Q , Ve/ q ) = on E for 
any a G §™ _1 and {Vs/a : a € S™ -1 } span the tangent bundle TE we conclude 
that E is totally geodesic, i.e. n = 0. 

We now claim that we can choose a such that Xa = 0. Indeed, a — > Xa is a 
continuous function on S n . Clearly u_ a = — u a and hence x_ Q = — y Q . Therefore 
by the intermediate value theorem there exists some (3 G § n_1 such that = 0. 
With this particular choice / = fp,u = up we have 

f L> 2 u = -ug, 
I — = 

There is g e E such that /(g) = max,/ = 1. Then Ve/(<?) = and hence 
Vu (g) = as |^ (g) = 0. For X G T q M such that (X, v (g)) < let 7x be the 

geodesic with j x (0) = X. Note that jx lies in E if X is tangential to E since E 
is totally geodesic. The function U (t) = u o j x (t) then satisfies the following 

' U(t) = -U, 
< C/(0) = 1, 

. i>(o) = o. 

Hence U (t) = cos i. Because E is totally geodesic, every point may be connected 
to q by a minimizing geodesic. Using the geodesic polar coordinates (r, £) G R + x 
§™~ at g wc can write 

g = dr 2 + h r 

where r is the distance function to g and h r is r- family of metrics on §™ _1 with 

lim r~ 2 h r = ho, 

■i — >o 
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here ho is the standard metric on S" . Then u — cosr. The equation D 2 u = —ug 
implies 

dh r cos r , 
IT- = 2^h r 
or sm r 

which can be solved to give h r — sin 2 r ho- It follows that (M,g) is isometric to 
S™. This implies Ai (M) = n and contradicts with the assumption Ai (M) > n. 
Theorem 1 follows. 
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